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Abstract 



In this paper, a random graph process {G'(t)}t>i is studied and its degree sequence is analyzed. 
Let {W(}i>i be an i.i.d. sequence. The graph process is defined so that, at each integer time 
' t, a new vertex, with Wt edges attached to it, is added to the graph. The new edges added 

at time t are then preferentially connected to older vertices, i.e., conditionally on G{t — 1), the 
probability that a given edge is connected to vertex i is proportional to di{t — 1) + S, where 
di{t — 1) is the degree of vertex i at time t — 1, independently of the other edges. The main 
Oh ' result is that the asymptotical degree sequence for this process is a power law with exponent 

r"| . T = min{Tw,Tp}, where Tw is the power-law exponent of the initial degrees {Wt}t>i and Tp 

the exponent predicted by pure preferential attachment. This result extends previous work by 
Cooper and Frieze, which is surveyed. 



1 Introduction 



Empirical studies on real life networks, such as the Internet, the World-Wide Web, social networks, 
and various types of technological and biological networks, show fascinating similarities. Many of 
the networks are small worlds, meaning that typical distances in the network are small, and many 
lO ' of them have power-law degree sequences, meaning that the number of vertices with degree k falls 
, off as k~'^ for some exponent r > 1. See [18] for an example of these phenomena in the Internet, 
f-*) I and [MIES] for an example on the World-Wide Web. Also, Table 3.1 in [26] gives an overview of 
a large number of networks and their properties. 

Incited by these empirical findings, random graphs have been proposed to model and/or explain 
r> I these phenomena - see |14) for an introduction to random graph models for complex networks. 
' Two particular classes of models that have been studied from a mathematical viewpoint are (i) 
graphs where the edge probabilities depend on certain weights associated with the vertices, see e.g. 
[ZllIOllIIlliaiSH], and (ii) so-called preferential attachment models, see e.g. [21 H El El 13] . The first 
class can be viewed as generalizations of the classical Erdos-Renyi graph allowing for power-law 
degrees. In |10) . for instance, a model is considered in which each vertex i is assigned a random 
weight Wi and an edge is drawn between two vertices i and j with a probability depending on 
WiWj. This model, which is referred to as the generalized random graph, leads to a graph where 
vertex i has an asymptotic degree distribution equal to a Poisson random variable with (random) 
parameter Wi as the number of vertices tends to infinity, that is, the asymptotic degree of a vertex 
is determined by its weight. We refer to [5l E2j for introductions to classical random graphs. 

Preferential attachment models are different in spirit in that they are dynamic, more precisely, 
a new vertex is added to the graph at each integer time. Each new vertex comes with a number of 
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edges attached to it and these edges are connected to the old vertices in such a way that vertices 
with high degree are more hkely to be attached to. It can be shown that this leads to graphs with 
power-law degree sequences. Note that, in preferential attachment models, the degree of a vertex 
increases over time, implying that the oldest vertices tend to have the largest degrees. 

Consider the degree of a vertex as an indication of its success, so that vertices with large degree 
correspond to successful vertices. In preferential attachment models, vertices with large degrees 
are the most likely vertices to obtain even larger degrees, that is, successful vertices are likely to 
become even more successful. In the literature this is sometimes called the rich-get-richer effect. 
In the generalized random graph, on the other hand, a vertex is born with a certain weight and 
this weight determines the degree of the vertex, as described above. This will be referred to as the 
rich-by-birth effect in what follows. 

Naturally, in reality, both the rich-get-richer and the rich-by-birth effect may play a role. To 
see this, consider for instance a social network, where we identify vertices with individuals and 
edges with social links, that is, an edge is added between two individuals if they have some kind 
of social relation with each other. Then, indeed, we would expect to see both effects: Firstly, the 
rich-get-richer effect should be apparent, since individuals with a high number of social links will 
in time acquire more new social links than individuals with few social links. Evidently, more social 
contacts imply that the individual is socially more active, so that he/she meets more people, and, 
in turn, each meeting offers a possibility to create a lasting social link. Thus, these individuals are 
more likely to get acquainted with even more individuals. Secondly, the rich-by-birth effect comes 
in due to the fact that some individuals are better in turning a meeting into a lasting social link than 
others. The social activity and skill varies from individual to individual and could be measured for 
instance by weights associated with the individuals. Hence, in reality, both the previous success of 
a vertex and an initial weight may play a role in the final success of the vertex. Naturally, there are 
several ways to model how the weight influences the success of a vertex. In the model considered 
in this paper, individuals arrive in the network with a different initial number of contacts (given to 
them at birth) and these initial numbers form the basis for their future success. Later on, we shall 
also discuss other ways of how this effect can be modeled. 

The aim of the current paper is to formulate and analyze a model that combines the rich-get- 
richer and the rich-by-birth effect. The model is a preferential attachment model where the number 
of edges added upon the addition of a new vertex is a random variable associated to the vertex. This 
indeed gives the desired combination of preferential attachment and vertex-dependency of degrees 
upon vertex-birth. For bounded initial degrees, the model is included in the very general class of 
preferential attachment models treated in [13], but the novelty of the model lies in that the initial 
degrees can have an arbitrary distribution. In particular, we can take the weight distribution to be 
a power law, which gives a model with two "competing" power laws: the power law caused by the 
preferential attachment mechanism and the power law of the initial degrees. In such a situation it 
is indeed not clear which of the power laws will dominate in the resulting degrees of the graph. Our 
main result implies that the most heavy-tailed power law wins, that is, the degrees in the resulting 
graph will follow a power law with the same exponent as the initial degrees in case this is smaller 
than the exponent induced by the preferential attachment, and with an exponent determined by 
the preferential attachment in case this is smaller. 

The proof of our main result requires finite moment of order 1 + e for the initial degrees. 
However, we believe that the conclusion is true also in the infinite mean case. More specifically, we 
conjecture that, when the distribution of the initial degrees is a power law with infinite mean, the 
degree sequence in the graph will obey a power law with the same exponent as the the one of the 
initial degrees. Indeed, the power law of the initial degrees will always be the "strongest" in this 
case, since preferential attachment mechanisms only seem to be able to produce power laws with 
finite mean. In reality, power laws with infinite mean are not uncommon, see e.g. Table 3.1 in ^26] 
for some examples, and hence it is desirable to find a model that can capture this. Unfortunately, 
we have not been able to give a full proof for the infinite mean case, but we present partial results 
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in Section [1.2i 

We now proceed with a formal definition of the model and the formulation of the main results. 



1.1 Definition of the model 

The model that we consider is described by a graph process {G{t)}t>i- To define it, let {Wj}i>i 
be an i.i.d. sequence of positive integer-valued random variables and let G(l) be a graph consisting 
of two vertices vq and vi with Wi edges joining them. For t > 2, the graph G{t) is constructed 
from G{t — 1) in such a way that a vertex vt, with associated weight Wt, is added to the graph 
G{t — 1), and the edge set is updated by adding Wt edges between the vertex vt and the vertices 
{vq, vi, . . . , vt-i}- Thus, Wt is the initial degree of vertex vt- Write do^s), . . . , dj_i(s) for the degrees 
of the vertices {vq, vi, . . . , vt-i} at time s > t — 1. The endpoints of the Wt edges emanating from 
vertex vt are chosen independently (with replacement) from {vq, . . . , vt-i}, and the probability that 
Vi is chosen as the endpoint of a fixed edge is equal to 



diit-l) + 6 di{t-l)+5 



0<i<t-l, (1.1) 



where Lt = Yl'i=i ^'^d (5 is a fixed parameter of the model. Write Sw for the support of the 
distribution of the initial degrees. To ensure that the above expression defines a probability, we 
require that 

5 + mm{x : x E S'w} > 0. (1.2) 

This model will be referred to as the PARID-model (Preferential Attachment with Random Initial 
Degrees). Note that, when Wi = 1 and 5 = 0, we retrieve the original preferential attachment 
model from Barabasi- Albert [2j. 

Remark 1.1 In the PARID-model, we assume that the different edges of a vertex are attached 
in an independent way, and we also take a simple choice for the initial graph G(l). However, the 
proofs given below are rather insensitive to the precise model definitions, and can be applied to 
slightly different settings as well. For example, the proof can also be applied to the model used in 
[9], where Wi = m for some integer m > 1, and the degrees are updated during the attachment of 
the successive edges (i.e., the m edges are not independent). 

Remark 1.2 We shall give special attention to the case where ¥{Wi = m) = 1 for some integer 
m > 1. This model is closest in spirit to the Barabasi- Albert model, and it turns out that sharper 
bounds are possible for the error terms in this case. These results will be used in [15], where we 
study the diameter in preferential attachment models. 



1.2 Heuristics and main result 

Our main result concerns the degree sequence in the resulting graph G{t). To formulate it, let 
Nk{t) be the number of vertices with degree k in G{t) and define Pkif) = Nk{t)/{t + 1) as the 
fraction of vertices with degree k. We are interested in the limiting distribution of pfc(t) as f — > oo. 
This distribution arises as the solution of a certain recurrence relation, of which we will now give 
a short heuristic derivation. First note that, obviously, 

nNk{t)\G{t - 1)] = Nk{t - 1) + nNk{t) - Nk{t - l)\G{t - 1)]. (1.3) 

Asymptotically, for t large, it is very unlikely that a vertex will be hit by more than one of the Wt 
edges added upon the addition of vertex vt- Let us hence ignore this possibility for the moment. 
The difference Nk{t) — Ni.{t — 1) between the number of vertices with degree k at time t and time 
t — 1 respectively, is then obtained as follows: 
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(a) Vertices with degree k in G{t — 1) that are hit by one of the Wt edges emanating from vt 
are subtracted from Nk{t — 1). The conditional probabihty that a fixed edge is attached to a 
vertex with degree k is {k + 5)Nk{t — l)/(2L(_i + t5), so that the expected number of edges 
connected to vertices with degree k is Wt{k + 5)Nk{t — l)/(2L(_i + t6). This coincides with 
the mean number of vertices with degree k in G{t — 1) hit by edges from vt, apart from the 
case when two edges are attached to the same vertex. 

(b) Vertices with degree /c — 1 in G{t — 1) that are hit by one of the Wt edges emanating from 
vertex vt are added to Nk{t — 1). By reasoning as above, it fohows that the mean number of 
such vertices is Wt{k - 1 + 6)Nk-i{t - l)/(2Lt_i + t6). 

(c) The new vertex vt should be added to Nk{t — 1) if it has degree k, that is, if Wt = k. 
Combining this gives 

E[Nk{t)-Nk{t-l)\G{t-l)] 

where the approximation sign refers to the fact that we have ignored the possibility of two or 
more edges of an arriving vertex being connected to the same end vertex. Now assume that Pkit) 
converges to some limit as t ^ oo, so that hence A'^fc(t) ~ (t + l)pk- Also assume that the 
distribution of the initial degrees has finite mean /i, so that Lt-i/t fi. Finally, let {rk}k>i be 
the probabilities associated with the weight distribution, that is, 

ri,=F{Wi = k), k>l. (1.5) 

Substituting (II. 4p into (II. 3p and replacing Lt-i by fit, we arrive, after taking double expectations, 
at 

E mt)] « mmt - 1)] + fcl±^E[7Vfc_i(t - 1)] - i^±^E[iVfc(t - 1)] + rfc, (1.6) 

where 6 = 2 + 6/ fi. Sending t oo, and observing that E[A^fc(t)] — E[A'^fc(t — 1)] — > p^ implies that 
jE[iVfe(i)] pk, for all k, then yields the recursion 

k-l+S k+6 
Pk = ^ Pk-i ^Pk + Tk- (1-7) 

By iteration, it can be seen that this recursion is solved by 

P' = kT5^e^''--^^^{k-3 + 5 + ey 

where the empty product, arising when i = 0, is defined to be equal to one. Furthermore, since 
{Pk}k>i satisfies (|1.7|) . we have that Y^^=iPk = Z^fcLi'^fc = 1- Hence, {pk}k>i defines a probability 
distribution, and the above reasoning indicates that the limiting degree distribution in the PARID- 
model should be given by {pk}k>i- Our main result confirms this heuristics: 

Theorem 1.3 // the initial degrees {VFj}i>i have finite moment of order 1 + e for some e > 0, 
then there exists a constant 7 E (0, ^) such that 



lim P max \pk{t) — Pk\ ^ i ^ ] = 0, 
t— >oo y k>l J 

where {pk}k>i is defined in hi. 8(1 . When rm = ^ for some integer m > 1, then t~^ can be replaced 
by Cy^Y^ for some sufficiently large constant C. 



4 



To analyze the distribution {pk}k>i: first consider the case when the initial degrees are almost 
surely constant, that is, when = 1 for some positive integer m. Then rj = for all j ^ m, and 
(jl.Sp reduces to 



Pk 



er{k+5)r{m+5+e) r ^ > 
for k < m, 



where r(-) denotes the gamma-function. By Stirling's formula, we have that T{s + a)/T{s) ~ 
as s — > oo, and from this it follows that pk ~ ck~^^~^^^ for some constant c > 0. Hence, the 
degree sequence obeys a power law with exponent 1 + = 3 + 6/m. Note that, by choosing 
6 > —m appropriately, any value of the exponent larger than 2 can be obtained. For other choices 
of {rk}k>i, the behavior of {pk}k>i is less transparent. The following proposition asserts that, 
if {rfc}fc>i is a power law, then {pk}k>i is a power law as well. It also gives the aforementioned 
characterization of the exponent as the minimum of the exponent of the r^'s and an exponent 
induced by the preferential attachment mechanism. 

Proposition 1.4 Assume that = P(VFi = k) = k~'^L{k) for some Tw > 2 and some function 
k H- >• L(k) which is slowly varying. Then pk = k~'^L{k) for some slowly varying function k i-^ L{k) 
and with power-law exponent t given by 

r = min{rw,rp}, (1.9) 

where Tp is the power-law exponent of the pure preferential attachment model given by Tp = 3 + 6/ fj,. 
When rk decays faster than a power law, then /il.9\} remains true with the convention that Tw = oo . 



In deriving the recursion (11.71) we assumed that the initial degrees {VFj}i>i have finite mean ^. 
Assume now that the mean of the initial degrees is infinite. More specifically, suppose that {rk}k>i 
is a power law with exponent Tw G [1, 2]. Then, we conjecture that the main result above remains 
true. 

Conjecture 1.5 When {rk}k>i is a power law distribution with exponent G (1)2), then the 
degree sequence in PARID-model obeys a power law with the same exponent Tw. 

Unfortunately, we cannot quite prove Conjecture [LSI However, we shall prove a slightly weaker 
version of it. To this end, write N-^k{t) for the number of vertices with degree larger than or equal 
to k at time t, that is, N>k{t) = Yl\=o '^{di{t)>k}, and let p>k{t) = N>k{t)/{t + l). Since di{t) > Wi, 
obviously 

np>m = ^^^f^ > ''^^^^'f-^^^ = w > = w > + oil)), (1.10) 

that is, the expected degree sequence in the PARID-model is always bounded from below by 
the weight distribution. In order to prove a related upper bound, we start by investigating the 
expectation of the degrees. 

Theorem 1.6 Suppose that Ylk>x = F(W^i > x) = x^^'^^ L{x) , where Tw G (1, 2) and x i— > L{x) 
is a slowly varying function at infinity. Then, for every s < Tw — 1, there exists a constant C > 
and a slowly varying function x i— > l{x) such that, for i S {0, . . . ,t}, we have that 



.iVl/ \l{i) 
where xV y = max{x, y}. 

Theorem 11.61 gives an upper bound for the expected degree sequence: 
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Corollary 1.7 IfJ2k>x = ^(Wi > x) = x^~'^ L{x) , where Tw G (1, 2) and x L{x) is a slowly 
varying function at infinity, then, for every s < — 1 , there exists an M ( independent of t) such 
that 

E[p>fc(t)] < Mfc-^ 

Proof. For s < Tw — 1, it follows from Theorem 11.61 and Markov's inequality that 

t t 

np>kit)\ = Y.^{d,{t) > k) = Y^Fid^ity > kn 

since, for s < r — 1 and using [17^ Theorem 2, p. 283], there exists a constant c > such that 

t 

^{i V i)-'/^^-^H{i)-' = ct^~^l{t)-'{l + o(l)). 

□ 

Combining Corollary 11.71 with (jl.lOp yields that, when the weight distribution is a power law 
with exponent Tw G (1,2), the only possible power law for the degrees has exponent equal to Tw. 
This statement is obviously not as strong as Theorem 11.31 but it does offer convincing evidence for 
Conjecture II. 5[ Theorem 11.61 is proved in Section [3l 



1.3 Related work 

Before proceeding with the proofs, we describe some related work. In Section 12.51 the proof of 
Theorem 11.31 is compared to related proofs that have appeared in the literature, and we refer there 
for the extensive literature on power laws for preferential attachment models. In this section, we 
describe work on related models. 

As mentioned in the introduction, the paper by Cooper and Frieze |13] deals with a very general 
class of preferential attachment models, including the PARID-model with bounded initial degrees. 
Another way of introducing the rich-by-birth effect in a preferential attachment model, is the fitness 
model, formulated by Barabasi and Bianconi [3l 0] , and later generalized by Ergiin and Rodgers 
[16j . We will shortly describe the model of Ergiin and Rodgers and some (non-rigorous) results for 
the degree sequence. 

The idea with the model is that vertices have different ability - referred to as fitness - to 
compete for edges. More precisely, each vertex has two types of fitness, a multiplicative and an 
additive fitness associated to it. These are given by independent copies of random variables rj and (, 
respectively. The dynamics of the model is then very similar to the dynamics of the PARID-model. 
However, instead of adding a random number of edges together with each new vertex, new vertices 
come with a fixed number m of edges. Also, instead of connecting an edge to a given vertex with 
a probability proportional to the degree plus 6, the probability of connecting to a given vertex 
is proportional to the degree times the multiplicative fitness plus the additive fitness. Thus, the 
expression p.ip for the probability of choosing Vi {0 < i < t — 1) as the endpoint of a fixed edge is 
replaced by 

rjidi{t -l)+Ci 



0<i<t-l. (1.12) 



The original fitness model of Barabasi and Bianconi is obtained when ( = 0. If, in addition, the 
multiplicative fitness is the same for all vertices, the model reduces further to the Albert-Barabasi 
model. 
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The rich-by-birth effect is present since relatively young vertices, with a small degree, can 
acquire edges at a high rate if the multiplicative fitness or the additive fitness is large. Therefore, 
this model is sometimes called the fit-get-rich model. Excluding trivial choices for the distribution 
of rj and it is not clear before hand if the graph process is driven by the rich-get-richer effect, by 
the rich-by-birth effect or by a combination of them. When the additive fitness is zero, Barabasi 
and Bianconi [3] show that the distribution of the average degree sequence of G{t) depends on the 
distribution of ij. For ij uniformly distributed on [0, 1], they show (non-rigorously) that the degree 
sequence {pfc}fc>i is given by 

^-(i+c*) 

Pk ~ c— — - — , 
log fc 

where C* is the solution of the equation exp (— 2/C) = 1 — 1/C and c > a constant, that is, the 
average degree sequence follows a generalized power law. When rj is exponentially distributed, nu- 
merical simulations indicate that the degree sequence also behaves like an exponential distribution. 
For the general model with non-zero additive fitness there are no explicit expressions for the PkS. 
See however [16] for some special cases. We mention also that [3j provides a coupling of the fitness 
model to a so-called Bose gas. This coupling gives a way of predicting (non-rigorously) whether 
the rich- get-richer or the rich- by-birth effect will be dominant. 



2 Proof of Theorem 11.31 and Proposition 11.41 

In this section, we prove Theorem 11.31 and Proposition II. 4i We start by proving Proposition 11.41 
since the proof of Theorem 11.31 makes use of it. 



2.1 Proof of Proposition 11.41 

Recall the definition (jl.Sp of p^. Assume that {rfc}fc>i is a power law distribution with exponent 
Tw > 2, that is, assume that = L{k)k^'^^ , for some slowly varying function k ^ L{k). We want 
to show that then is a power law distribution as well, more precisely, we want to show that 
Pk = L{k)k~'^ , where r = minjrw, 1 + ^} and k i— > L{k) is again a slowly varying function. To this 
end, first note that the expression for pk can be rewritten in terms of gamma-functions as 



Pk 



9-r{k + 6) ^T{m + S + e) 



T{k + 6 + l + 9) r(m + S) 

^ ' m=l ^ ' 



V M'"^"^^; .2 11 



By Stirling's formula, we have that 
and 

V, \ =m^ l + 0(m-^)), m^oo. 2.3 
Furthermore, by the assumption, = L{m)m~'^ . It follows that 

k 



r{m + 5 + e) 



^ r(m + 6) 



(2.4) 



is convergent as A: — > oo if — Tw < —1, that is, if Tw > 1 + 9- For such values of Tw, the distribution 
Pk is hence a power law with exponent Tp = 1 + 9. When 9 — > —1, that is, when < Tp, the 
series in (j2.4p diverges and, by [171 Lemma, p. 280], it can be seen that 

' T{m + 6 + 9) 

m=l 
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varies regularly with exponent — Tw + 1- Combining this with ()2.2p yields that pk (compare (|2.ip ) 
varies regularly with exponent r^, as desired. □ 



2.2 Proof of Theorem [TTSl 

The proof of Theorem II .31 consists of two parts: in the first part, we prove that the degree sequence 
is concentrated around its mean, and in the second part, the mean degree sequence is identified. We 
formulate these results in two separate propositions - Proposition 12.11 and 12.21 - which are proved 
in Section 12.31 and 12.41 respectively. 

The result on the concentration of the degree sequence is as follows: 

Proposition 2.1 // the initial degrees {Wi}i>i in the PARID-model have finite moment of order 
1 + £, for some e > 0, then there exists a constant a G 1) such that 



lim P max 

t^oo V fc>i 



Nk{t)-¥.[Nk{t)] 



> = 0. 



When = 1 for some m > 1, then can be replaced by C^Jt log t for some sufficiently large C. 
Identical concentration estimates hold for N^j^it) . 

As for the identification of the mean degree sequence, the following proposition says that the 
expected number of vertices with degree k is close to {t + l)pk for large t. More precisely, it asserts 
that the difference between K[Nk{t)] and {t + l)pk is bounded, uniformly in k, by a constant times 
t^, for some jS £ [0, 1). 

Proposition 2.2 Assume that the initial degrees {Wj}i>i in the PARID-model have finite moment 
of order 1 + e for some e > 0, and let {pk}k>i be defined as in ( fj.gj) . Then there exist constants 
c > and (3 G [0, 1) such that 

max \&[Nk{t)] -{t + l)pk\ < ctf^. (2.5) 

A;>1 

When rm = ^ for some m > 1, then the above estimate holds with /? = 0. 

With Propositions 12.11 and 12.21 at hand it is not hard to prove Theorem 11.31 
Proof of Theorem II. 3t Combining (|2.5p with the triangle inequality, it follows that 

max \Nk{t) -{t + l)pk\ >ct^ + t"'] < P (max \Nk{t) - E[Nk{t)] I > t 

k>l / \ ^—^ 

By Proposition 12.11 the right side tends to as t ^ oo and hence, since Pkit) = Nk{t)/{t + 1), we 
have that 

/ -\-t"\ 

lim P I max \pk(t) — Pk\ > I = 0. 

t->oo \^fc>l '^''^ ^ - t+1 J 

The theorem follows from this by picking < 7 < 1 — maxja,/?}. Note that, since < /3 < 1 and 
i < a < 1, we have < 7 < i. The proof for = 1 is analogous. □ 



2.3 Proof of Proposition 12.11 

This proof is an adaption of a martingale argument, which first appeared in [9j, and has been 
used for all proofs of power-law degree sequences since. The idea is to express the difference 
Nk{t) — E[A^fc(t)] in terms of a Doob martingale. After bounding the martingale differences, which 
are bounded in terms of the random number of edges {Wj}i>i, the Azuma-Hoeffding inequality 
can be applied to conclude that the probability of observing large deviations is suitably small, at 
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least when the initial number of edges has bounded support. When the initial degrees {Wi}i>i are 
unbounded, and extra coupling step is required. The argument for N>kit) is identical, so we focus 
on Nk{t). 

We start by giving an argument when Wi < t"' for alH < t and some a G (0, ^). First note that 

Nkit) <j:J2^mt) <-j2m{t) = ^. (2.6) 

l=k 1=1 

Thus, lK[Nk{t)] < jxt/k. For a G 1), let 77 > be such that r/ + a > 1 (the choice of a will be 
specified in more detail below). Then, for any k > f, the event \Nk{t) — E[A^fc(t)] | > implies 
that A'^fc(t) > f", and hence that Lf > kNi.{t) > f^"". It follows from Boole's inequality that 

P (max|iVfc(t) -E[iVfc(t)] | > ) < ^ p(|iVfc(t) - E[iVfc(t)] | > t") + P(Lt > 
^ ^ k=i 

Since r] + a > 1 and Lt/t — > fi, the event Lt > has small probability. To estimate the 

probability P (I iVfc(t) - K[Nk{t)] \ > introduce 

Mn = E[Nk{t)\Gin)], n = 0,...,t, 

where G(0) is defined as the empty graph. Since E[M„] < 00, the process is a Doob martingale 
with respect to {G(n)}^^Q. Furthermore, we have that Mt = Ni:{t) and Mq = K[Nk{t)], so that 

Nk{t)-E[Nk{t)]=Mt-Mo. 

Also, conditionally on the initial degrees the increments satisfy |M„ — M„_i| < 2Wn- To 

see this, note that the additional information contained in G{n) compared to G{n — 1) consists in 
how the Wn edges emanating from Vn are attached. This can affect the degrees of at most 2Wn 
vertices. By the assumption that Wi < t"" for all i = 1, . . . , t, we obtain that |M„ — M„_i| < 21"". 
Combining all this, it follows from the Azuma-Hoeffding inequality - see e.g. [19^ Section 12.2] - 
that 

p(|iV,(t) - nm)] I > e) < 2exp { - ^^r^2a } = 2exp {-t^^-i-^Vs} , 

so that we end up with the estimate 

P('max|iVfe(t) -E[Affc(t)] | > < 2t'' exp {-t^^-i-s^/s} + p(Lj > (2.7) 
V fc>i / 

Since a < 1/2, the above exponential tends to for a < 1 satisfying that a > a + 1/2. When the 
initial degrees are bounded, the above argument can be adapted to yield that the probability that 
maxfc>i \Nk(t) — E[A'^fc(t)] | exceeds C y/t log t is o(l) for some C > sufficiently large. We omit the 
details of this argument. 

We conclude that we have proved the statement for graphs satisfying that Wi < t"" for some 
a £ (0, 1/2) and all i = 1, . . . ,t. Naturally, this assumption may not be true. When the initial 
degrees are bounded, the assumption is true, even with replaced by m, but we are interested in 
graphs having initial degrees with finite (1 + e)-moments. We next extend the proof to this setting 
by a coupling argument. 

Write 

s 

Wl = W,At'', L', = ^Wl, (2.8) 

1=1 

where x A y = min{x,y}. Then, the above argument shows that the PARID-model with initial 
degrees {Wl}^^-^ satisfies the claim in Proposition [2Tj Denote the graph process with initial degrees 
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{Wl}l^-^ by {G'{i)}l^^ and, for i < s, the degree of vertex i in G'{s) by d'^{s). We now present a 
coupling between {G{i)}l^i and {G'(i)}-^]^ which is such that, with high probabihty, the number 
of edges that differ is bounded by for some 6 G (0, 1). 

Define the attachment probabihties in and by 

2Ls_i + OS ^^s-i + 

Now, we couple the edge attachments such that the l^^ edge of vertex s in both graphs is attached 
to i with probability Pi[s) Ap[{s). Otherwise, the edge is miscoupled. We shall give a bound on 
the expected number of miscouplings. The number of miscouplings in G{s) and G'{s) is denoted 
by Us, and is defined in more detail as follows. We define f7o = and explain recursively how to 
construct Us from Us-i- 

The number of miscouplings is adjusted after each edge which is connected. We consider the 
edges to be directed, and call a directed edge pointing towards i an in-edge for i, and a directed 
edge pointing away from i an out-edge for i. For convenience later on, we regard an edge from s 
to i as both an in-edge for i as well as an out-edge for s. By the above definitions, the number of 
in-edges of i at time s is the in-degree of i at time s, and the number of out-edges of i at time s is 
the out-degree of i at time s. If we denote the in- and out-degrees of vertex i in G{s) by di^\^{s) 
and di,out(s), then clearly di{s) = dj^in(s) -|- (ij^out(s)- The same holds for the in- and out-degrees 
4,m(«) and d-_out(s) of vertex i in G'{s). 

The edges which are attached from vertex s are numbered \,...,Ws- When Ws > t"", then 
an edge with a number between and Ws adds 2 to Ug-i, and we call both the in-edge of i and 
the out-edge of s as belonging to the miscoupled set. The size of the miscoupled set at any time 
s = 0, . . . ,t will be equal to Us- 

When the edge number is in between 1 and W!., then we add 1 to Us-i precisely when the edge 
is connected differently for G{s) and G'(s). In this case, we say that the in-edge of i belongs to the 
miscoupled set, but the out-edge of s does not. The miscoupled set remains unchanged when an 
edge is attached in the same way in G{s) and in G'{s). 

We next define the weight of every in- and out-edge of vertex i at time s to be equal to 1. The 
total weight of a vertex i in G{s) at time s is the sum of weights of the in- and out-edges of i in 
G{s) plus 5. The total weight of a vertex i in G'{s) is defined in a similar manner. 

The probabilities in (12. 9p are precisely proportional to the total weight of the vertex i at time 
s — 1. As a result, for an out-edge of vertex s with number in between 1 and W!., a miscoupling 
occurs with probability equal to Us-i/TWs-i, where TW^ is the total weight of all vertices at 
time s (i.e., all weights in G{s) and G'{s) combined) plus 6s. To see this, we can choose an edge 
with probability equal to the total weight of the end vertex of the edge divided by TW^. If this 
edge is not in the miscoupled set, then we are done, and the two (directed) edges in G{s) and 
G'{s) are equal to an in-edge in the vertex which is connected to the chosen (directed) edge, and 
an out-edge from the vertex s. If the chosen (directed) edge is in the miscoupled set, then it is 
an edge either for G{s — 1) or for G'{s — 1), but not for both, and it is chosen with the correct 
(conditional) probability. The above rule then constructs the in- and out-edges corresponding to 
the edge we wish to attach. Say the chosen edge is an edge for G{s — 1), then we choose the edge 
for G'{s — 1) from the edges of G'{s — 1) with probability equal to p'^{s — 1). As a result, we do not 
create any miscoupling when the initial edge drawn was not in the miscoupled set. The probability 
of a miscoupling at time s is therefore equal to Us-i/TWs~i- Note that TW<j > 2Ls + S{s + 1). 

The following lemma bounds the expected value of Ut'. 

Lemma 2.3 There exists a constants K > and b £ (0, 1) such that 

E[Ut] < Kt\ (2.10) 
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Proof of Lemma 12. 3t We prove Lemma 12.31 by induction. The induction hypothesis is that, for 
all < s < t, 



nus] < K 



(2.11) 



The bound in (j2.10p follows from the one in (j2.1ip by substituting s = t. 

We now prove (j2.11|) . For s = 0, we have Uq = 0, which initializes the induction hypothesis. 
To advance the induction hypothesis, we note that Us is equal to Ug-i + 2{Ws — Wg) + Rg, where 
Rs is the number of out-edges for s with number in between 1 and Wj, that are miscoupled. As a 
result, we have 

E[;7,] = E[Us-i] + 2E[Ws - W^] + E[Rs]. (2.12) 

By the fact that for each out-edge for s with number in between 1 and Wg, a miscoupling occurs 
with probability equal to Us-i/TWs~i, we have that 



E[Rs 



E 



E[Rg\Ws[ 



E 



W. 



, Us 



TW 



s-l 



U. 



s-l 



TW 



s-l 



(2.13) 



where the last equality follows from the independence of Wg and (C/s_i, TWs_i). Now, we use that 
TWs_i > 2L<j_i + 5{s — 1), together with the fact that Lg is concentrated around its mean, to 
conclude that Lg-i > (// — e)(s — 1) with high probability. Thus, 



E[Rg 



E 



E[Rg\Wg 



< 



A* 



(s-l)(2/x + (5-2e 
Using the induction hypothesis, we arrive at 



-E[Ug.i] + /iP(L,_i < (^ - e)(s - 1)) . (2.14) 



E[Rg] < 



[s - l){2ix + 6 - 2e 



-K 



f + linLs-i < (/i-e)(s-l)) 



< Kt 



6-1 



+ /xP(L,_i < {^l-e){s-l)). 



{2ix + 5- 2e 
We further bound 

E[Wg - W'g] = E[{Wg - e)l{Ws>t'^}\ < t-'^'EiW^+'j < Ct-'''. 
Therefore, by taking b — 1 = —ae, we get that 

E[Ug] < E[Ug-i] + 2E[Wg-W'g]+E[Rg] 

+ fiF{Lg^i < in - e){s - 1)) 



(2.15) 



(2.16) 



(s - 1) + 2C/K + 



{2^l + 6- 2e 



{2fi + 6- 2e) 



+ /xP(L,_i < (/i-e)(s-l)) 



(2.17) 



by noting that f[Lg < (/i — e)s) is exponentially small in s, for s oo, and using that, since 
2fj, + 6 > fi, we can take e > so small that /i/(2/i + 6 — 2e) < 1, and, after this, we can take K so 
large that 

H 2C 



+ 



< 1. 



(2/i 5 - 2e) K 

With these choices, we have advanced the induction hypothesis. □ 

We now complete the proof of Proposition 12. 1[ The Azuma-Hoefding argument proves that 
A^j(.(i), the number of vertices with degree k in G'{t), satisfies the bound in Proposition 12. H i.e., 
that (recah ([2771) ) 

P (^max |A^^(t) - E[N'^{t)] | > j < 2t^ exp {-t2"-i-2a/g| ^ p^^/ > ^r,+a^^ (2.18) 
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for a G (|, 1) and ry > such that a + 77 > 1 and a G (0, ^). Moreover, we have for every /c > 1, 
that 

|iVfc(i)-iVfc(t)| < f/t, (2.19) 

since every miscoupHng can change the degree of at most one vertex. By ()2.19p and (j2.10p . there 
is a 6 G (0, 1) such that 

E[iVfe(t)] - E[iV^(t)] < E[C/t] < Kt^. (2.20) 
Also, by the Markov inequahty, (I2.19P and (I2.10p . for every a. G (6, 1), we have that 

max \Nk{t) - N'^{t)\ > t") < ¥{Ut > t") < t'^^Kpt] = o(l). (2.21) 
Now fix a G (6 V (a + ^), 1), where x V y = maxjj;, y}, and decompose 

ma.x\Nk{t)-E[Nk{t)]\ < max |iV^(t) -E[iV^(t)]| +max |E[Affc(i)] -lE[A^fc(t)]| +max |Affc(t) -iV^(t)|. 

fc>l k>l k>l k>l 

(2.22) 

The first term on the right hand side is bounded by t" with high probabihty by (|2.18p . the second 
term is, for t sufficiently large and with probability one, bounded by by (|2.2Up while the third 
term is bounded by t° with high probability by (j2.2ip . This completes the proof. □ 



2.4 Proof of Proposition HH] 

For k>l, let 

Nk{t)=E[Nk{t)\{Wi}U] (2.23) 

denote the expected number of vertices with degree k at time t given the initial degrees Wi, . . . , Wt, 
and define 

ek{t) = Nk{t) -{t + l)pk, k>l. (2.24) 

Also, for Q = {Qk}k>i a sequence of real numbers, define the supremum norm of Q as \\Q\\ = 
supfc>i IQfcl- Using this notation, since E[iVfc(t)] = E[Nk{t)], we have to show that there are 
constants c > and f3 G [0, 1) such that 

||E[e(t)] II = sup|E[iVfc(t)] - (t + l)pfc| < ct^, for t = 0,l,..., (2.25) 

k>l 

where e{t) = {ek{t)}'^^^. The plan to do this is to formulate a recursion for e{t), and then use 
induction in t to establish (j2.25p . The recursion for e{t) is obtained by combining a recursion for 
N{t) = {Nk{t)}k>i, that will be derived below, and the recursion for pk in (jl.7p . The hard work 
then is to bound the error terms in this recursion; see Lemma 12.41 below. 

Let us start by deriving a recursion for N{t). To this end, for a real- valued sequence Q = 
{Qk}k>Oi with Qo = 0, introduce the operator Tt, defined as (compare to (jl.6p l 



When applied to N{t — 1), the operator Tf describes the effect of the addition of a single edge 
emanating from the vertex vt, the vertex vt itself being excluded from the degree sequence. Indeed, 
there are on the average Nk-i{t — 1) vertices with degree A; — 1 at time t — 1 and a new edge is 
connected to such a vertex with probability {k — 1 + 6) /{2Lt~i + 15). After this connection is made, 
the vertex will have degree k. Similarly, there are on the average Nk{t — 1) vertices with degree k 
at time t — 1. Such a vertex is hit by a new edge with probability {k + 6)/{2Lt-i + t6), and will 
then have degree k + 1. The expected number of vertices with degree k after the addition of one 
edge is hence given by the operator in (|2.26p applied to N{t). 
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Write T" for the n-fold application of Tf, and define T/ = . Then T/ describes the change 
in the expected degree sequence N{t) when all the Wt edges emanating from vertex vt have been 
connected, ignoring vertex vt itself. Hence, N{t) satisfies 

Nkit) = (TlNit - + l{w^=k}, k>l. (2.27) 

Introduce a second operator S on sequences of real numbers Q = {Qk}k>Oj with Qq = 0, by 
(compare to (II. 7p ) 

{SQ)k = ''~l^^ Qk-i - ^Qk, k>l, (2.28) 

where 6 = 2 + 5/^ and ^ is the expectation of Wi. 

The recursion (|1.7p is given by pk = {Sp)k + rk, with initial condition = 0. It is solved by 
p = {pk}k>\-, as defined in (jl.Sp . Observe that 

(t + l)pk = tpk + {Sp)k + rk = t{T[p)k + rk- Kkit), k>l, (2.29) 

where 

Kk{t) = t{Tlp)k - {Sp)k - tpk. (2.30) 

Combining (^iM), (12:271) and and using the hnearity of T/, it follows that e{t) = {ek{t)}k>i 

satisfies the recursion 

ek{t) = {T[e{t - l))k + l{wt=k} -rk + Kk{t), (2.31) 

indeed, 

Skit) = Nk{t) - {t + l)pk 

= {TlN{t - l))k + l{wt=k} - t{Tlp)k -rk + Kk{t) 

= {Tle{t-l))k + l{Wt=k}-rk + i^k{t)- 

Now we define kt = r]t, where rj £ (/x, 2fi + 6). Since, by (jl.2p . 6 > — min{x : x E S'w} > —fJ-, the 
interval (/i, 2^+5) ^ 0. Also, by the law of large numbers, Lj < kt, as t — > oo, with high probability. 
Further, we define ek{t) = £k{t)l^k<kt} note that, for k < kt, the sequence {ikit)}k>i satisfies 

Skit) = l{fc<fc,}(r/e(t - l))fe + l{wt=k} -rk + fik{t), (2.32) 

where Kk{t) = Kk{t)l^k<kt}- 1^ follows from E[l{vt/^j=;j}] = and the triangle inequality that 

\\E[e{t)] II < ||E[e(t) - e{t)] \\ + ||E[e(t)] || 

< \\E[e{t) - e{t)] II + ||E[l(_^,fc,](-)T/e(t - 1)] || + \\E[ii{t)] ||, (2.33) 

where l(-oo,fct](^) = l{fc<fct}- Inequality (I2.33P is the key ingredient in the proof of Proposition 12. 2[ 
We will derive the following bounds for the terms in (|2.33p . 

Lemma 2.4 There are constants Cs, Ci^' andC^, independent oft, such that fort sufficiently 
large and some (3 S [0, 1), 

(a) \\E[e{t) - e{t)]\\ < 

(b) ||E[l(_^,,,](.)r/e(t - 1)] II < (l - 4^) ||E[e(t - 1)] || + 

(c) ||E[K(t)]||<^. 

When = 1 for some integer m > 1, then the above bounds hold with P = 0. 
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Given these bounds, Proposition 12.21 is easily established. 

Proof of Proposition 12. 2t Recall that we want to establish (I2.25p . We shall prove this by 
induction on t. Fix Iq £ N. We start by verifying the induction hypothesis for t < to, thus 
initializing the induction hypothesis. For any t <to, we have 

\\E[eit)] II < supE[iVfc(t)] + (to + 1) suppfc < 2(to + 1), (2.34) 
fc>i fc>i 

since there are precisely to + 1 vertices at time Iq and pfc < 1. This initializes the induction 
hypothesis, when c is so large that 2{tQ + 1) < cIq. Next, we advance the induction hypothesis. 
Assume that (I2.25P holds at time t — 1 and apply Lemma 12.41 to (12.331) to get that 

\\E[e{t)] II < \\E[e{t) - e{t)] II + ||IE[l(_oo,fc,](-)7^/e(i - 1)] II + l|E[^(t)] || 

< iT3«+ c(^-lr + 7T3« + 



. ,0 C-C7i^'-(gf +Ce- + gK) 
- ^1-/3 ' 

as long as 1 — > 0, which is equivalent to t > Ci^'. If we then choose c large so that 
c • Ci'' > Cf' + + C^i and c > 2(to + \)to^ (recah (l23iD ) and to > C"!'', then we have that 
||IE[e(t)] II < ct^, and follows by induction in t. □ 

It remains to prove Lemma 12.41 We shall prove Lemma 12.41 (a)-(c) one by one, starting with 

(a). 

Proof of Lemma [2T4l (a): We have ||E[e(t) - e(t)] || < IE[||e(t) - e(t)||], and, using the definition 
of e(t), we get that 

||e(t) -e(t)|| = sup|iVfc(t)-(t + l)^)fc| < supiVfc(t) + (t + l)suppfc. 

k>kt k>kt k>kt 

The maximal possible degree of a vertex at time t is L^, implying that sup;.^^^ Nk{t) = 0, when 
Lt < kt. The latter is true almost surely when = 1 for some integer m, when t is sufficiently 
large, since for t large Lt = mt < rjt = kt, where t] G (m,2m + d), by the fact that fi = m and 
6 > -m. On the other hand, by (pIBj) . with Nk{t) replaced by iVfc(t) we find iVfc(t) < |^ for A: > fc^, 
and we obtain that 

E[sup iVfc(t)] < {kt)-^E[La{L,>k,}]- (2.35) 

k>kt 

With kt = rjt for some rj G (/i, 2^ + 5), we have that 

nLa{L,>k,}] < krnLl+'l{L,>k,}] < k^'E[\Lt - /.t^^] + {^it)'+'krFiLt > h), (2.36) 
and, by the Markov inequality 

nLt > h) < ^{\Lt - /itr^ > {kt - fity+') < {kt - Mt)-(i+^)E[|Li - f,t\'+% 

Combining the two latter results, we obtain 

E[Ltl{L,>k,}] < K'{^ + {^y^')n\Lt - f^t\'+% (2.37) 

To bound the last expectation, we will use a consequence of the Marcinkiewicz-Zygmund in- 
equality, see e.g [2D1 Corollary 8.2 in §3], which runs as follows. Let q G [1,2], and suppose that 
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{Xi}i>i is an i.i.d. sequence with E[Xi] = and E[|Xi|'?] < oo. Then there exists a constant Cq 
depending only on q, such that 



E 



Z 

[IE 

1=1 



< c,tE[|Xi^|] . 



(2.38) 



Applying (j2.38p with q = 1 + e, we obtain 



E[sup Nkit)] < k 



k>kt 



1 + 



r]-fi 



l+e 



E[\Lt - fit\'+'] < ci+,t 



(2.39) 



Furthermore, since by Proposition 11.41 we have pk < ck , for some 7 > 2 (see also ()1.9p ). we have 
that sup^>fcj Pk < ct~^ for some constant c. It follows that 

(J 

(t + l)suppfc < -zzT, 

k>kt I ' 

and, since 7 > 2, part (a) is established with = ci+e + Cp, and 1 — /3 = (e A 7) — 1. 



□ 



Proof of Lemma 12.41 (b): Moving on to (b), we will start by showing that for t sufficiently large, 
\\E[\-ooM]{-)Tte{t - 1)] \\<\l- j ||E[l(_^,,^](.)e(t - 1))] II + (2.40) 

which is (b) when we condition on Wt = 1. We shall extend the proof to the case where Wt > 1 
at a later stage. To prove (j2.4Up . we shall prove a related bound, which also proves useful in the 
extension to Wt > 1. Indeed, we shall prove, for any real-valued sequence Q = {Qk}k>o-, satisfying 
(i) Qo = and (ii) 

sup|fc + 5||Qfc| < QLi.!, (2.41) 

k>l 

that there exists a /? G (0, 1) (independent of Q) and a constant c > such that for t sufficiently 
large. 



|E[l(_oo,fc.](-)7^tQ] II < (^1 - P[l(-oo,fc.](-)Q] II + ^ 



(2.42) 



Here we stress that Q can be random, for example, we shall apply (j2.42p to e{t — 1) in order to 
derive (pliO]) . 

In order to prove (j2.42p . we recall that 



E[{TtQ)k] = E 



1 



k + 6 



2Lt-i + tS 



k-1+6 ^ 



k>l. 



(2.43) 



In bounding this expectation we will encounter a problem in that Q^, which is allowed to be 
random, and Lf-i are not independent (for example when Q = e{t — 1)). To get around this, we 
add and subtract the expression on the right hand side but with the random quantities replaced 
by their expectations, that is, for k > 1, we write 



1 



k + 5 



+ {k + 5)E 



2fi{t-l) + t6j ' 2fi{t-l) + t6 
2Lt-i - 2fi{t - 1) 



Qk 



+ {k + 6-l)E 



{2Lt_i+t5){2fi{t-l)+t6) 
' 2/i(t - 1) - 2Lt_i 

VA;-l 



{2Lt^i+t5){2^i{t-l)+t5) 



(2.44) 
(2.45) 
(2.46) 
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Note that, when r^a = ^ for some integer m > 1, then Lt = fit = mt. Hence the terms in ()2.45l 
I2.46P are both equal to zero, and only (I2.44[) contributes. We first deal with ()2.44l) . Observe that 
k < kt = r]t, with r] £ (/x, 2/x + 5), implies that k < (2/x + S){t — 1) for t sufficiently large, and hence 



1 



k + 6 



2/i(t -l)+t6 



> 0. 



It follows that, for t sufficiently large 

k + 6 



sup 

k<kt 



1 



< 1 



2fi{t -l)+t6 
1 

~ 2ij,{t -l)+t5 



nQk] + 



k-l + 6 
2^{t -l)+t5 



nQk- 



(2.47) 



(2.48) 



) ||E[l(_oo,fc,](-)Q] II < (l-^)||E[l(_ooA](-)Q] 



for some constant Ce^K This proves (j2.42p - with Cq = - when the number of edges is a.s. 
constant since (j2.451 12.46P are zero. It remains to bound the terms (12.451 12.46P in the case where 
the number of edges is not a.s. constant. We will prove that the supremum over k of the absolute 
values of both these terms are bounded by constants divided by t^~^ for some /? G [0, 1). Starting 
with (j2.45p . by using the assumption (ii) in (|2.4ip . as well as 2Lj_i + 5t > Lt-i for t sufficiently 
large, it follows that 



sup 

k>l 



{k + 5)E 



2Lt_i - 2^(t - 1) 
(2Lt^i + t5){2fi{t - I) + t6) 



< 



cCc 



.E[|L 



/.(t-l)l]. 



To bound the latter expectation, we combine (j2.38p for q = l + e, with Holders inequality, to obtain 



E[|Lt-^f|] < 



E 



\Lt - fit\ 



l+e 



1/(1+^) 



< Ci+etE 



l+e 



< ct^/^^+'\ (2.49) 



since Wi have finite moment of order 1 + e by assumption, where, without loss of generality, we 
can assume that e < 1. Hence, we have shown that the supremum over k of the absolute value of 
()2.45p is bounded from above by a constant divided by t^~^, where /? = 1/(1 + e). That the same 
is true for the term (j2.46p can be seen analogously. This completes the proof of (|2.42p . 

To prove ()2.40p . we note that, by convention, eo{t — 1) = 0, so that we only need to prove that 
supfc>i \k + 5||efc(t — 1)1 < cLf-i. For this, note from (|2.6p . the bound pk < ck~'^ , 7 > 2, and from 
the lower bound Lt > t that 



sup \k + 6\\ek{t - 1) 

k>l 



< ^(k + \5\)\ek{t - 1)\ 
k>l 

< J2^k + \6\)Nk{t-l)+tY,ik + \S\)pk 

k>l k>l 

< Lt-i + \6\{t - 1) +tY,ik + \6\)pk < cLt-i, 



(2.50) 



k>l 



for some constant c. This completes the proof of (I2.40p . 

To complete the proof of Lemma 12.4( b). we first show that (j2.42p implies, for every 1 < n < i, 
and all A; > 1, 



^l{k<k,}{Tre{t-l)), 



< 



1 



|E[l(-oo,M(-Ki-l)] II + 7T 



(2.51) 



To see (|2.5ip . we use induction on n. We note that (j2.5ip for n = 1 is precisely equal to ()2.40p . 
and this initializes the induction hypothesis. To advance the induction hypothesis, we note that 



l{k<k,}{TMt - 1))^ = l|,<,^|Ti(Q(n - 1)),, 



(2.52) 
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where Qk{n — 1) = l{k<kt} (^^" ^(^ ~ 1) j • We wish to use (I2.42p . and we first check the assump- 
tions (i-ii). By definition, Qoin — 1) = 0, which estabhshes (i). For assumption (ii), we need to do 
some more work. According to (|2.26p . and using that 2Lt_i + 15 > Lt-i > t — 1, for t sufficiently 
large, 



+ mTtQ), < ( 1 + y ) + I'^i)^'^' 

k=l ^ ^ k=l 



and hence, by induction, 

n-l oo 



/ 1 \ "~ 



k=l ^ ' k=l 

Substituting = £k{i — 1) and using \ek{t — 1)| < Nk{t — 1) + tp^, yields 
(fc + \6\){Tr'N{t - 1)), + t ^ (A: + \6\){Tr'p)k 

k<kt k<kt 

1 + 7 + - 1) + ^ + 7 * + I'^l)^'^ 

^ A:=l ^ ^ k=l 

<(l + ^) -cLt^i, (2.53) 

according to (|2.50p . Using the inequality 1 + x < , x > 0, together with n < t, this in turn yields, 

sup|fe + <5||Qfc(n-l)| <exp(l)cLt_i, (2.54) 
fc>i 

which implies assumption (ii). 

By the induction hypothesis, we have that, for k < kt, 

nQkin - 1)] < (l - ||E[l(_^,,j(.)e(t - 1)] II + ^TZ^, (2-55) 

so that we obtain, from (j2.42p . with Q = l(^_^^f.^j{-)Tte{t — 1), 

KMk<kATMt-l)),] < (l-^) l|IE[l(-oo,..](-)^(i-l)] ll + ^"~^ff^^'^^ (2.56) 

which advances the induction hypothesis when Ci^^ > cCq. 
By (j236l) . we obtain that, for Wt < t, 



IE[l{fe<fe,}(T/e(t-l))JVFt] < ||EKt-l)|Tyi]|| + 



^1-/3 



-^) PKt-i)]|| + ^, 

where we use that e(t — 1) is independent of Wt- In the case that Wt > t, we bound, similarly as 
in (I230D . 

sup I (T/e(t-l)) J <cLt, (2.57) 

k<kt 

SO that 

E[l{fc<fc^}(r/e(t-l))JVFt] < (^l-^J \\E[e{t-l)]\\ + ^^ + cE[Ltl{w,yt}\Wt]. (2.58) 
The bound in (b) follows from this by taking expectations on both sides, using 

nLti^w,>t}] = f^{t - mwt > t)+E[Wti^w,^t}] < + ^)nwi^% (2.59) 

after which we use that f3 = 1/(1 + e) > 1 — e and choose the constants appropriately. This 
completes the proof of Lemma l2.4r bl. □ 
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Proof of Lemma 12.41 (c): For part (c) of the lemma, recall that 

Kk{t) = Kk{t)l{k<k^y with Kk{t) = t{{T[ - I)p)k - {Sp)k, (2.60) 

where Tt is defined in (I2.26|) . Tj. = , S is defined in (12.280 . and where / denotes the identity 
operator. In what follows, we will assume that k < kt, so that Kk{t) = Kk{t). We start by proving 
a trivial bound on Kk{t). By ()2.3ip . we have that 

f^kit) = Skit) - {Tle{t - l))fc - l{wt=k} + rk, (2.61) 

where sup;,>| kA:(OI ^ by (|2.5U|) and s\vpi^f.^f.^ \{Tle{t — l))k\ < cLt by (|2.57p . so that hence 

sup \Kk{t)\ < C^Lt. (2.62) 

k<kt 

(recall that kt = rjt where r] S (^,2^ + 5)). For x G [0, 1] and S N, we denote 

fk{x;w) = [{I + x{Tt-I)rp)^. 

Then Kfc(t) = K,k{t;Wt)-, where 

Kk{t; w) = t[fk{l; w) - fk{0; w)] - {Sp)k, (2.63) 
and X ^ fkix; w) is a polynomial in x of degree w. By a Taylor expansion around x = 0, 

fk{l;w)=pk + iu{{Tt-I)p)^ + ^fl!ixk;w), (2.64) 

for some Xk G (0, 1), and, since / + x{Tt — I) and Tt — I commute, 

/^'(x; w) = w{w - 1) ((/ + x{Tt - I)r-\Tt - ifp)^. 

We next claim that, on the event {kt < 2Lt_i + {t — 1)(5}, 



sup 

k<kt 



{{I + x{Tt-I))Q)^ < suplQfcl. 

k<kt 



Indeed, / + x{Tt — /) = (1 — x)I + xTt, so the claim follows when sup;j<^j \(TtQ)k\ < sup^^/.^ \Qk\- 
The latter is the case, since, on the event that k + S < 2Lt-i + t6, and arguing as in (j2.48p . we have 

(k -\- 5 \ k — 1 -\- S 

V iLt-i + to / k<kt 



Since k < kt, the inequality k + 5 < 2Lt-i + 15 follows when kt < 2Lj_i + {t — 1)5. 
As a result, on the event {kt < 2Lt-i + {t — 1)6} , we have that 

max sup \f'j!{x;w)\ < w{w — 1) sup \ ({Tt — /)^p),|. (2.65) 

x&lO,l]k<kt k<kt 

Now recall the definition (j2.28p of the operator S, and note that, for any sequence Q = {Qk}kLiJ 
we can write 

((Tt - I)Q)k = 7Tr-^—77^iSQ)k = ^{SQ)k + {RtQ)k, (2.66) 
(2Lt_i + to) tn 

where the remainder operator Rt is defined as 

- V^^^ " 2Lt.,+t5 ) + [2Lt-,+t6 ~ ^^i^ ) ^^■^^> 
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Combining (I2J3|), tHM^i . (|2:65]) and dMS]), on the event {h < 2Lt„i + {t-l)6} and uniformly for 
k < kt, we obtain that 



w 



1 ) {Sp)k + wt sup \{Rtp)k\ + lw{w - l)t sup \{{Tt - J, (2.68) 

/ k<kt ^ k<kt 



together with a similar lower bound with minus signs in front of the last two terms. Indeed, 

Kk{t; w) = t[fk{l; w) - /fc(0; w)] - {Sp)k 

= tw{{Tt - I)p)^ + \tf^{xkM - {Sp)k 

= + wt{Rp)k - {Sp)k + ]^tfk{xk;w), 

and (j2.68p follows from this identity and (j2.65p . 

With (I2.68[) at hand, we are now ready to complete the proof of (c). We start by treating the 
case where = 1 for some integer m > 1. In this case, with w = Wt = m = /i, we have that 

— l){Sp)k = 0. Furthermore, the inequality kt < 2Lt-i + {t — 1)6 is true almost surely when t 
is sufficiently large. Hence, we are done if we can bound the last two terms in (|2.68p with w = Wt- 
To do this, note that, by the definition (|2.26p of Tt and the fact that 2Lt-i + t6 > kt = r]t, with 

7/ > /i, 

(2.69) 



sup 

k>l 



{{Tt-I)Q)^ < -sMk + \6\)\Qk\ 



Applying (12.69P twice yields that 



< 



v'^t'^ k>\ 



sup(/c + \d\fpk, 



and hence, since by Proposition 11.41 Pk ^ ck for some 7 > 2, there is a constant Cp such that 



suv{k + \5\fpk<Cp. 



k>l 



(2.70) 



Finally, since Lt = mt, we have that 



2 2C 
\{Rtp)k\ <—-—snp{k + \5\)pk < . \. . 

m[t — \)t k>i rn[t — \)t 

Summarizing, we arrive at the statement that there exists Cm,6 such that 

I /j. M ^ Cm, (5 
sup \Kk{t;m)\ < ——, 

k<kt t 

which proves the claim in (c) when = 1, and with /3 = 0. 

We now move to random initial degrees. For any a £ (0, 1), we can split 

Kk{t) = Kk{t)l{Wt<t'^} + ^fe(i)l{VKt>t''}- 



(2.71) 



On the event {A;^ < 2Lt-i + (t — 1)6}, the first term of (j2.7ip can be bounded by the right side of 
dMH]), i.e., 

'^A:(i)l{VKt<t"} 



< ( (Wt/fi - l){Sp)k + tWt sup \iRtp)k\ + ^' 

k<kt ^ 



t sup \ {{Tt - I) p)j^\]l^Wt<t'^}, 

k<kt 



19 



with a similar lower bound where the last two terms have a minus sign. From (|2.62p . we obtain 
the upper bound 

Combining these two upper bounds with (I2.7ip . and adding the term {Wt/n — l){Sp)k'i-{Wt>t^} 
the right side, yields that on the event that {kt < 2Lt-i + {t — ^)S}, 



fWt \ 

Kk{t) < 1 {Sp)k + tWtlswt<t''} sup \{Rtp)k\ 

V / k<kt 

+ *^t^l{Tyt<t"} sup I {{Tt - lfp)^ \ + l{Wt>t-}CnLt 

k<kt 



(2.72) 



and similarly we get as a lower bound, 



fWt \ 

Kk{t) > 1 {Sp)k - tWtlswt<t<'} sup \ {Rtp)k\ 

V M / k<kt 

- tW^^{Wt<t-} sup |((Ti - lfp)j^\ - l{Wt>t-} ( Cs 

k<kt 



(2.73) 



+ CrjLt 



where we used that supfc>i \ {Sp)k\ < Cs- We use (!2.72j) and (|2.73p on {kt < 2Lt-i + {t - 1)5], and 
(|2.62p on the event {kt > 2L(_i + {t — 1)6} to arrive at 



Hkit) < 



Wt \ 

1 {Sp)k + tWtlswt<t'^} sup \ {Rtp)k\ 

/ k<kt 

tWll{Wt<t-} sup \ {{Tt - /)^p) J + {l{Wt>t-} + l{ykt>2Li_i+{t-l)5}) ( C, 
k<kt \ 



(2.74) 



with a similar lower bound where the last three terms have a minus sign. We now take expectations 
on both sides of ()2.74p and take advantage of the equality E[Wt//u] = 1 and the property that {Sp)k 
is deterministic, so that the first term on the right side drops out. Moreover, using that Wt and 
Lt-i are independent, as well as that kt > 2Lj_i + (t — 1)6 implies that Lt-i < kt, we arrive at 



|E[Kfe(t)]| < E 



Wt 

— - 1 



+ Crjt 



+ (c^{kt + E[Wt]) +CsE[ 



w 



sup \ {RtP)k\ 
k<kt 



E 



Wtl 



t-L{m>t"} 



+tE[Wt\w,<t'^y]E\ sup I {{Tt - I)^p) 



-k<kt 



(2.75) 

t > 2Lt-i + {t- 1)6) (2.76) 

(2.77) 
(2.78) 



We now bound each of these four terms one by one. To bound (j2.75p . we use that Wt has finite 
(1 + e)-moment, to obtain that 



E[l{w,^t^yWt] =E[l{H.,>tn^r^M < E[l^/+^] = 0(r 



and, 



which bounds (j2.75p as 



E 



W 



+ Cfjt 



0{f 



(2.79) 



with h = max{— ae, 1 — a(l + e)}. 
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To bound (|2.76p . we use that when kt > 2Lt_i + {t — 1)6, then < ^{rjt — 6{t — 1)) = 

^{r] — 6){t — 1) + ^7]. Now, since rj G (^,2^ + 6), we have that ^{rj — 6) < /x. Standard Large 
Deviation theory and the fact that the initial degrees Wi are non-negative give that the probabihty 
that Lf-i < a{t — 1), with o" < ^, is exponentiahy small in t. As a result, we obtain that 



Cr,{kt + nWt]) + C«E[|^ - l|])p(fet > 2Lt_i + {t- 1)5) = 0{r^). 



(2.80) 



To bound ()2.77p . we use that 2Lt_i + t5 > >t — 1 > t/2, and also use (j2.70p . to obtain 



that 



Thus, 



E 



k<kt 



sup \ {Rtp)k\ < To^Lt-i - t^|sup(A; + \5\)pk < -n^L 



t-i 



k>l 



tE 



sup \ {Rtp)k\ 

k<kt 



E 



Wtl 



t^{Wt>t''} 



< ^E\Lt-i - tfi\ ■ r"' < o , 



(2.81) 



where the final bound follows from (j2.49p . 
Finally, to bound (j2.78p . note that 

E[W,%w,^,a^] = E[Wl-^'W^+'l{w^^,ay] < t'^(i-)E[t^/+^] = O 

and, by (|2.26p and the fact that 2Lt-i + 16 > rji for some rj > 0, we have 



E 



snp \{{Tt - I)^p) 

k<kt 



< -^supik + \5\)'pk. 

t k>l 



(2.82) 



This leads to the bound that 



tE[W?l{W^^^a^]E 



sup I {{Tt - I)^p) 



k<kt 



(2.83) 



Combining the bounds in (j2.79p . (j2.80p . (j2.8ip and (|2.83p completes the proof of part (c) of Lemma 
[XH for any a such that l/(e + 1) < a < 1. □ 

2.5 Discussion and related results 

In this section, we discuss the similarities and the differences of our proof of the asymptotic degree 
sequence in Theorem 11.31 as compared to other proofs that have appeared in the literature. 

Virtually all proofs of asymptotic power laws in preferential attachment models use the two 
steps presented here in Propositions 12.1] and [2T2l For bounded support of Wi, the concentration 
result in Proposition 12.11 and its proof are identical in all proofs. For unbounded Wi, an additional 
coupling argument is required. The differences arise in the statement and proof of Proposition 
12. 2[ Our Proposition 12.21 proves a stronger result than that for 5 = appearing in [9] for the 
fixed number of edges case, and in |I3] in the random number of edges case, in that the result is 
valid for a wider range of k values and the error term is smaller. Indeed, in [13], the equivalent of 
Proposition 12.21 is proved for k < t^^"^^, and in [9] for < t^^^^. 

In [13], also a random number of edges {Wi,}i>i is allowed. However, it is assumed that the 
support of Wi is bounded, in which case the Azuma-Hoeffding argument presented in Section 12.31 
simplifies considerably. The nice feature of allowing an unbounded number of edges is the compe- 
tition of the exponents in ()1.9p . The model in [13] is much more general than the model discussed 
here, and at every time allows for the creation of a new vertex with a random number of edges or 
the addition of a random number of edges to an old vertex. Under reasonable assumptions on the 
parameters of the model, a power law is proved for the degree sequence of the graph, indicating 
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that the occurrence of power laws is rather robust in the model definition (in contrast to the value 
of the power-law exponent). Due to the complexity of the model in [13], the asymptotic degree 
sequence satisfies a more involved recurrence relation (see [13l Eq. (2)]) than the one in (jl.7p . 

We close this discussion by reviewing some related results. Similar results for various random 
graph processes where a fixed number of edges is added can be found in [21j, where also similar error 
bounds are proved for models where a fixed number of edges is added. In [6], a directed preferential 
attachment model is investigated, and it is proved that the degrees obey a power law similar to 
the one in p]. Finally, in [TJ, the error bound in Proposition 12.11 is proved for m = 1 for several 
models. The result for fixed {VFt}t>i and m > 1 is, however, not contained there. We intend to 
make use of this result in order to study distances in preferential attachment models in [15j. For 
related references, see [21] and [29]. We finally mention the results in [23] . There, a scale-free graph 
process is studied where, conditionally on G{t), edges are added independently with a probability 
which is proportional to the degree of the vertex. In this case, as in [9j, the power-law exponent 
can only take the value r = 3, but it can be expected that by incorporating an additive (5-term as 
in (|l.ip . the model can be generalized to r > 3. Since (5 < is not allowed in this model (by the 
independence of the edges, a degree is zero with positive probability), we expect that only r > 3 is 
possible. 



3 Proof of Theorem 11.61 

In this section, we write F{x) = F{Wi < x), and assume that 1 — F{x) = x^~''^L{x) for some slowly 
varying function x i— > L{x). Throughout this section, we write t = t^. 
From (jl.ip it is immediate that 



di{t) = di{t - I) + Xi^t, 



fori = 0, 1,2, ...,t-l. 



(3.1) 



where, conditionally on di{t — 1) and {Wj}*-^^, the distribution of Xi^t is binomial with parameters 
Wt and success probability 



2Lt-i + 16 



Hence, for t > i. 



E[idiit) + 6y] = E[E[{di{t -l) + 5 + X.^tY \di{t - 1), 

< E[{di{t -I) +6 + E[X,,t\d^{t - 1), , 



(3.3) 



where we have used the Jensen inequality E[(a + Xy] < {a + E[X]y , which follows from concavity 
of 1 1-^ (a + 1)* for < s < 1. Next, we substitute E\Xi^t\di{t - 1), {WjYj^-^ = Wtqi{t) and use the 
inequality 2Lt-i + td > Lt-i + 5, to obtain that 



{di{t-l)+5Y [1 + 
{di{t-l)+5Y (l + 



Wt 



2Lt_i + 15 
Wt " ' 



E[{d^{t)+5y]<E 

<E (di(t-l)+5Y + =E 
The above two steps can be repeated, for t > i -|- 1, to yield 



{d^{t-l) + 5Y 



Lt + 5 
Lt-i + S 



E[idi{t)+6y] < E 
< E 



E 



{di{t-l)+5Y di{t-2),{WjY^^ 



Lt + 5 

Lt-i + S 



{d,{t-2) + 6Y 



Lt-i + 6 



Lt-2 + S J V Lt-i + 5 



Lt + 5 
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Thus, by induction, and because di{i) = Wi, we get that, for alH > i > 1 

t 



E[{d^{t)+5y]<E 



n=i+l 



Ln + S 



Ln-1 + S 



E 



m + 5y 



Lt + 6 
Li + 5 



(3.4) 



The case i = can be treated by E[((io(i) +5)*] = K[{di{t) +5)**], which is immediate from the 
definition of G(l). 

Define f{Wi) = {W^ + 6y and 



9iW^) 



Lt + 6 
L, + 6 



1 + 



W^+l + Wi+2 + --- + Wt 

W1 + W2 + ... + Wi + 6 



and notice that when we condition on ah Wj, 1 < j <t, except Wi, then the map Wi 
increasing in its argument, whereas Wi ^ giWi) is decreasing. This imphes that. 



Hence, 

E[idi{t) + 6y]<E[iW, + 5y]E 



E[f{Wi)g{Wi)] < E[fiW^)]E[g{W, 
Lt + 5 



fiW,) is 
(3.5) 



Li + 6 



where in the final step we have applied the inequality (j3.5p once more. 

For i — > 00, 

E [{Li + 6)-'] = (1 + o(l))E [Lr-] , E [{Lt + 6y] = (1 + o(l))E [Lf] 
The moment of order s of Wi + 5 can be bounded by 

1^1 



< E[(Wi + 5y]E [{Lt + Sy] E [(L, + 5)-'] , (3.6) 

(3.7) 

E[{Wi + ,5)'^] <E^Wi \^1 + ^J ^<{1 + |<5|)^E[W,^] = (1 + \S\yE[Wl] , (3.8) 

since Wi > 1. Combining (j3.6|) . (|3.7|) and (|3.8|) gives for i sufficiently large and t > i, 

E[{di{t) + 6y] < (1 + \S\yE[Wl] E [LT'] E [Lf] (1 + o(l)). (3.9) 

We will bound each of the terms E[PF^f], E [Lf] and E [L^^~\ separately. 

It is well known that a positive random variable, where the tail of the survival function is 
regularly varying with exponent 1 — r possesses all moments of order s < r — 1, so that E[Wf ] < 00 

Take a norming sequence {a„}„>i such that 



sup <j X : 1 — F{x) > — ^ , 



(3.10) 



then it is immediate that a„ = n^^^'^^^h{n), where n 1— > l{n) is slowly varying. Also, conveniently, 
we have that 1 — F(an) > 1/n. In the Appendix (cf. Lemma |4. 11 part (a)), we show that for some 
constant Cs 

E[Lt] = C.af (1 + 0(1)) < Csf/^^~'h{ty. (3.11) 

As a second result, we prove in the Appendix (cf. Lemma [4.1^ part (b)), that, for i sufficiently 
large, 

E[L-^] < Csa-' = Csi-''^^-^^l{i)-'. (3.12) 
Combining the equations (j3.9p , (j3.1ip and (j3.12p , we obtain 



i V 1 



(3.13) 



Finally, we note that, since di{t) > min{x : x £ S'w} = 6 + 1' where v > 0, and using (jl.2p . we 
can bound E[di{ty] < (1 V ly'^yEKdiit) + 6y], which together with establishes the proof of 

Theorem 11.61 sub i ect to the proof of Lemma |4.H parts (a) and (b). □ 
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4 Appendix 

Lemma 4.1 Let F(x) = ¥(Wi < x), and assume that 1 — F{x) = x^~'^L{x), and let Lf = Yll=i 
where {Wi}*^^ are i.i.d. copies ofWi. Then, there exists a constant Cg such that 

(a) ¥{Ll] = Csalil + o(l)) < Csf/^^-^H{ty . 

and 

(b) E[L-*] < Csa^' = c,^-*/(^-^)^(^)-^ 

Proof: We start with part (a). We bound 

Ll = {Ut + Vty <2\Ut + Vi), 

where 

t t 

Ut = Yl ^ilW>a*}' = E Wjhw,<a,} (4.1) 
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By concavity of x i— > x**, 

E[y/] < {E[Vt]r < {t£\l - F{x)] dxY ~ (2 - t)-X, 
according to [17^ Theorem 2(i), p. 448]. For the other term, we use that 

Ut < xw^,^, 

where W^t) = niaxi<j<t PFj, the maximum summand and X the number of Wj, ^ < j < t, which 
are larger than at- Then from the Holder inequality with p,q > 1 such that p^^ + q^^ = 1, 

E[;7/] < {E[X'P])^/P{E[W','^]y/'>. (4.2) 

Prom t[l — F{at)] — > 1, we see that all moments of X are bounded, so taking q > 1, but arbitrarily 
close to 1, we can assume that < Tw — 1, and it follows from Theorem 2.1 of [27] that 

where is the limit in distribution of VF(t), since E[(^'*'^] is finite when sq < t — 1. Hence, 

E[U!] < (E[X^P])i/P(E[t^f,^])i/'? = Oiiaty^y^" = 0((at)^). (4.3) 

Combining these bounds yields the bound (a) of the lemma. 

We now turn to part (b) of the proof. We use that Lt > VF(t), so that 

E [l;^] < E [ly-;] = -e [(-y^.^l , (4-4) 

where Yi = -Wf^ and Y(t) = maxi<j<tyj. Clearly, Yi G [-1,0], so that E[(-Yi)*] < oo. Also, 
atY(t) = —at/W^t) converges in distribution to —E~^^^'^^~^\ where E is exponential with mean 1, 
so again it follows from [271 Theorem 2.1] that 

E [{at/LtY] < -E [i-atY^.^Y] ^ E[i?-i/(--i)] < oo. (4.5) 

□ 
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